Mass 211:

Current Landscape of Human Service Demands in Massachusetts

Jesse Yang

2017-03-30

Introduction

This report is a rough analysis of all the 211 calls made between Feb 25, 2016, and Feb 9, 20171 If I understood the data correctly, the new system was still in testing before May 2016, because the number of calls were really small before that time. So the report is actually based on data frame May 2016 to Feb 2017., using the iCarol reports generated on Feb 9. All the numbers and facts are of the whole time span, i.e., they are about the whole landscape of human service requests received by Mass 211 during the past approxmiately 10-month period.

Both AIRS Problem/Need Categories (17 items) and the Taxonomy’s Level 5 terms (871 items) were used for analysis. The former was used for high-level analyses and the latter for understanding exact purposes of the calls.

Key Findings

Drilling Down

The flow

Have you used Mass211 before? How did you hear of Mass211? AIRS I&R Need Category Referrals Made

Above graph shows where the calls were coming from and where the callers were referred to. The majority of them are from first-time callers referred by human service agencies. Housing and Income Support/Assistance are undoubtly the two most inquired issues. For Income Support/Assistance requests, the vast majority of them were about Massachusett Early Education and Care (EEC) program.

Calls with multiple purposes

A call may have multiple purposes, and henthforth be referred to multiple agencies. About one-third of Mass 211 calls were labled with more than one Taxonomy term (although they may still be of single purpose).

So which services relate to each other the most so that peple needed to request them all together in one call?

Top 10 Level 5 Taxonomy term combinations

Purposes of a call Num. of Calls % of all calls
Electric Service Payment Assistance
  & Government Consumer Protection Agencies
258 0.84
Child Care Expense Assistance
  & Early Head Start Sites
189 0.61
Child Care Expense Assistance
  & Family Support Centers/Outreach * Children
142 0.46
Child Care Centers
  & Child Care Expense Assistance
124 0.40
Homeless Shelter
  & Housing Search Assistance * Tenants
124 0.40
Electric Service Payment Assistance
  & Utility Service Complaints
120 0.39
Child Care Expense Assistance
  & Head Start Sites
99 0.32
Electric Service Payment Assistance
  & Heating Fuel Payment Assistance
95 0.31
Child Care Expense Assistance Applications
  & Early Head Start Sites
  & Family Support Centers/Outreach * Children
85 0.28
Child Care Expense Assistance Applications
  & Family Support Centers/Outreach * Children
84 0.27

The most common case of multiple purpose calls were those asking for child care assistance programs together with information regarding child care providers (child care centers or early start sites).

Another common case is people making complaints about utility companies while seeking financial assistance in utility payment.

Obviously, calls with multiple purposed would get multiple referrals; but even for single purpose calls, they do also receive multiple referrals. In fact, 40% of all calls were referred to at least two external agency, but 31% of them were associated with only one Taxonomy term.

Calls with single purpose

So what are the top requests from calls with single purpose?

Top 10 Level 5 Taxonomy terms for single purpose call

Taxonomy Term Num. of Calls % of all calls
Child Care Expense Assistance 8116 26.34
Child Care Expense Assistance Applications 1233 4.00
Homeless Shelter 1029 3.34
211 Systems 1002 3.25
Rent Payment Assistance 989 3.21
Electric Service Payment Assistance 821 2.66
Directory Assistance 407 1.32
Food Pantries 275 0.89
Food Stamps/SNAP Applications 259 0.84
Housing Search Assistance * Tenants 225 0.73

Child care related calls took the largest portion of the caseload, mostly because the collaboration between Mass 211 and Massachussets Department of Early Education and Care.2 EEC requests seem unique to Mass 211, as I have found no other states were having the same high-volume of calls related to child care. Mass 211 not only handles inquires regarding EEC programs, but also takes in applications and status updates for such programs. Some parents frequently called to check their application status.3 About 20% of child care related calls were explicitly marked as status check. To reduce workload, it may be beneficial to reassess how parents were informed with the expected processing time, if that haven’t been done before.

“211 Systems” are mostly cross-border calls from neighboring states; “Directory Assistance” are those intended for 411. They both seem underisable and unavoidable in the meantime.

Putting these categories aside, the most frequently inquired human services are EEC Applications, Homeless Shelter/Rent Assistance, Electricity, and Food.

Call length

Average call length of all calls is 8.3 minutes. Most calls (75%) finish within 10 minutes, 95% of them finish within 20 minutes. Some took as long as 40 minutes or more, but those were rare cases and often involved interpretation services (the caller didn’t speak English).

When removed undesired calls (211 Systems and Directory Assistance), which normally end quickly, the average call length becomes 8.8 minutes.

Mean, median and quantiles of call length

minimum q1 median mean q3 maximum
0.5 3.5 6.5 8.334 10.5 403.5

If taking call length into consideration, the list of top categories by caseload would be different. Following are the average call length and number of calls aggregated to the Level 5 Taxonomy term.

The most time-consuming calls

Taxonomy Term Avg. call length Num of calls Minutes per day
Child Care Expense Assistance 7.93 10436 306.69
Rent Payment Assistance 10.05 5601 208.52
Homeless Shelter 11.05 4838 198.00
Electric Service Payment Assistance 9.53 4592 162.11
Child Care Expense Assistance Applications 13.38 2054 101.81
Food Pantries 11.87 1913 84.08
Heating Fuel Payment Assistance 11.81 1571 68.71
Food Stamps/SNAP Applications 11.02 1635 66.71
Housing Search Assistance * Tenants 10.54 1491 58.20
Family Support Centers/Outreach * Children 13.74 923 46.98

When aggregating call length for categories, the call length of a call with multiple categories was evenly divided and assigned to each purpose.

Following treemap shows the total time consumption in terms of call length for all Taxonomy terms.

This is a hieratic treemap, you can click on the tiles to enter a subcategory, then click on the title bar at the top of the chart to go back.

Geographic Distribution

Since most 211 services are about helping needy families and individuals, the geographic distribution of 211 calls inevitably strongly correlates with the income level of a neighborhood.

A multiple linear regression was calculated at the zip code level to predict the number of calls per 1,000 residents based on their income, race, and education level.

I have chosen percentages of people who completed at least a Bachelor’s degree , percentages of white people, and median house income measured in 1,000 US dollars as the prediction variables. An interaction term “Race: White × Income” was also included to reveal any potential interaction between the effects of house income and race.

Dependent variable:
Number of calls per 1,000 people
Education: Bachelor and Above (%) -0.040***
(0.010)
Race: White (%) -0.188***
(0.017)
Median House Income (1K USD) -0.146***
(0.027)
White:MedianHouseIncome 0.001***
(0.0003)
Constant 22.738***
(1.291)
Observations 482
R2 0.551
Adjusted R2 0.548
Residual Std. Error 2.714 (df = 477)
F Statistic 146.548*** (df = 4; 477)
Note: *p<0.1; **p<0.05; ***p<0.01

Calculated from 477 ZIP code areas, this model explains 47% of the variation, and statistical significance was seen for all variables.

The number of calls per 1,000 people in a 10-month period would decrease 0.04 per 1 percent increase in people with a Bachelor’s degree, 0.188 per 1 percent increase in white residents, and 0.146 per $1,000 increase in median house income.

For different races (white and non-white), the effect of income may differ, but the difference is very small (only 0.001 calls)–when it comes to whether call 211 for help, white people (or residents in predominantly white neighborhoods) are less affected by having a lower income.

In above graph, the slope of the two lines indicate how much the change of income affects the change of calls. For ZIP codes with higher percentage of white residents, the absolute value of the slope is smaller, indicating a smaller effect.

Category correlations

A call may naturally have multiple purposes, but does a call for certain service predict the need of other service types?

To answer this question, we can check the concordance of need categories, i.e. the correlation between volumes of calls in different categories.

Take the most requested two service categories for example, zip code areas with higher demands for Income Support (Child Care Assistance) almost always have a high demand for Housing Assistance (Kendall’s tau coefficients \(r_{\tau}\) = 0.471, p < 0.000).

The same strong correlation can be found at most AIRS Need Category pairs.

Concordance between service categories

Concordance between service categories

This graph shows the ordinal association (Kendall’s tau) for each pair of AIRS Problem/Need categories. The darker the blue, the more in agreement the two are–which means a neighborhood either have a high volumn of calls related to both, or low on both. Transparent tiles represent insignificant results, mostly because of low call volume. To minimize bias, ZIP codes with no call in either of the categories were removed before calculation.

The most obvious correlated pairs are

It is not immediately clear whether calls of different categories are from the same group of people or not and what do these correlations actually mean. We would need to dive deeper for each category and use the Taxonomy terms to boil things down.

Notes

Data Treatment

This report is based on the raw iCarol reports; the data were manually cleaned and transformed, with a few noteworthy controls:

  1. Only regular Mass 211 calls are used4 ReportVersion = Mass 211. “Call2Talk”, “Runaway Form”, and “Mass 211 Text”, “Mass 211 Chat” were all ignored, the reason being that their number are small and they often contain incomplete or unique data fields, which means some separate analyses are more appropriate.
  2. Different data fields about the same information were merged into one. For example, “Data Collection - How did you Learn about Mass211” and “Caller Data - How Heard about Call2Talk?” are treated as one field.
  3. Some missing records of AIRS Problem/Needs categories were completed with inferences from the Taxonomy. E.g., “Target People -> Low Income” was mapped to “Income Support/Assistance”.
  4. All call length values were increased by 0.4 minutes, because they were zero-based and sums of zeros would add biases into the “minutes per day” metric.

Service types

The Taxonomy provides a comprehensive and logical hieratic structure for human services, but this indexing method is not suitable for analysing and reporting purposes–end-level terms are too granular, and upper levels too broad and not self-explanatory.

The AIRS: I&R Problem/Needs National Categories5 The linked document is outdated. It contains only 16 categories, but AIRS has split “Housing/Utility” into two separate categories in 2014, making it 17 categories in our case. as seen in the MetUnmet report is a better candidate for reporting, and was used in the flow chart, but such categorization is also not revealing enough. For instance, “Income Support” does not reveal the fact that the overwhelmingly majority of this type of need is for Early Education and Care.

The optimal solution for problem is to create a flat, topic-based categorization method that aligns with the unique demands of Massachusetts constituents. But curating such a list is a time-consuming process and would need vigorous validation. That is why I used AIRS Neet Categories for general analaysis, but Level 5 Taxonomy terms to reveal more details in call purposes.

Conclusions and next steps

This report presents the big picture of the state’s human service needs based on the data from past year and created graphs and tools to explore some basic characteristics of current landscape.

We have also identified three major demographic factors affecting the usage of 211: income, race and education attainment. The result is not so surprising, but a quantified predictive model could be a good starting point for future analysis.

EEC calls are a too large portion of the caseload and may have unfairly skewed the data and overshadowed other problems/needs. They seem to be a far less acute social problem. Maybe it would be a good idea to isolate them in the future.

My next step would be to cross-validate the demands with more (external) data sources and start bringing other data fields into the picture: age, sex, military status, etc.

But before doing that, building a simple and robust typology is still an unresolved major challenge. I have tried some name matching using Regular Expressions, but it did not work well for all cases. Another approach would be to hand pick a few terms from different levels of the Taxonomy and map them with specific topics we want to discuss–mental health and substance abuse, for example.

Questions

  1. Any comments on these discoveries? What else would you like to see me working on? Any specific questions you are seeking answers of?
  2. Are agency resources categorized in any way in the system? E.g., being tagged as Police, Municipality Service, Government Aide Program, Volunteer and Charity, Hospital, Shelters, etc. In the flow chart, I grouped the agencies using simple keywords matching with the names. Had we an official categorization method, the obscure “Other Agency” chunk would look much smaller.
  3. Is the typology used by 211counts.org known to you? Did they develop the whole thing by themselves or is it yet another shared categorization system just like the Taxonomy and AIRS Problem/Need Categories?
  4. Did the merging of Call2Talk and 211 change the way you work or how you keep logs of these calls?
  5. If I understood it correctly, the “ReferralsMade” column in call_reports is about which agencies the call were referred to. Some Call2Talk calls have the ReferralsMade as Call2Talk. Is it because this is a required field, and an internal referal was made as the default value? Or does this case have a special meaning?
  6. It seems the iCarol system also provides some statistics. Can I have a screenshot of their charts or the list of features they have? So I won’t be working on things you already have.
  7. May I have access to http://mass211.org/mass-211-stats/? It’s password protected.